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A/ 

A  probabilistic  device  developed  by  Anscombe  and  Woodroofe  is 
used  to  obtain  a  local  limit  theorem  for  a  class  of  hitting  times 
associated  with  transient  one-dimensional  random  walks.  Applications 
of  this  local  limit  theorem  to  ruin  problems  and  to  nonlinear  renewal 
theory  are  given. 
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THE  ANS COMB E-WOODROOFE  METHOD  IN  RENEWAL  THEORY 


Many  random  walk  problem8  (particularly  thoae  arising  in 
sequential  statistical  analysis)  call  for  precise  information  concern¬ 
ing  both  the  hitting  time  and  the  hitting  place  of  a  half-line.  If 

{S  }  is  a  random  walk  with  positive  drift  y  and  finite  variance  a , 
n 

and  if  T  -  min{n  :  S  > a} ,  then  it  is  well-known  that  S  -a  has  a 
an  T 

a 

-1  3/2  -1  -1/2 

limiting  distribution  as  a  -*■  °°,  that  (t^  -  ay  )y  '  a  a  has 
approximately  a  standard  normal  distribution  «  a  +  ®,  and  that  the 
two  variables  in  question  are  asymptotically  independent.  Sometimes, 
however,  stricter  limiting  statements  are  necessary:  for  example,  a 
local  limit  theorem  in  T  . 

A 

Such  a  theorem  was  obtained  by  A.  Borovkov  ([ 3  ])  under  the 
assumption  that  the  underlying  distribution  of  the  increments  in  the 
random  walk  be  strongly  nonlattice  and  have  a  finite  two-sided  Laplace 
transform.  Borovkov's  proof  relies  heavily  on  the  complex-variable 
machinery  related  to  the  Wlener-Hopf  method  for  solving  integral 
equations.  Unfortunately,  the  asymptotic  representation  for  the  hit¬ 
ting  probabilities  is  not  very  explicit  (it  is  not  even  apparent  from 

-1  -1/2 

Borovkov's  theorem,  for  example,  that  (t  -ay  )a  has  a  limiting 

A 

normal  law) . 

A  rather  different  approach  to  limit  theorems  for  hitting 
times  was  discovered  by  F.  J.  Anscombe  ([l  ])  in  his  study  of  sequen¬ 
tial  estimation  procedures,  and  has  recently  been  exploited  by 
M.  Woodroofe  ([14],  [15],  [16])  in  a  variety  of  contexts,  all  of  them 


involving  the  crossing  of  curved  boundaries.  The  essence  of  this 
method  is  a  conditioned  limit  theorem  for  the  random  walk,  which  in 


turn  is  derived  from  a  local  limit  theorem  for  the  density  of  S  . 

n 

The  conditioned  limit  theorem  is  then  used  to  obtain  unconditional 
renewal-type  theorems,  large  deviation  probabilities  for  various  hit¬ 
ting  times,  or  results  concerning  the  moments  of  hitting  times. 

In  the  theorems  to  follow  the  method  of  Anscombe  and 
Woodroofe  will  be  adapted  to  local  limit  problems  for  hitting  times. 
The  usefulness  of  these  local  limit  theorems  will  be  illustrated  in  a 
very  simple  derivation  of  a  large  deviation  theorem  generalizing 
Cramer's  ruin  estimates.  (To  the  best  of  my  knowledge  no  such  large 
deviation  theorem  has  previously  appeared  in  the  literature.)  In 
contrast  to  Woodroofe' s  work,  no  absolute  continuity  conditions  will 
be  Imposed  on  the  random  walk:  the  only  condition  needed  for  the 
validity  of  the  theorems  is  a  finite  second  moment. 

Local  limit  theorems  for  hitting  times  are  also  valid  for  a 
class  of  "perturbed"  renewal  processes.  Such  processes,  introduced 
by  Lai  and  Siegaund  [  7  ],  are  especially  pertinent  to  sequential  sta¬ 
tistical  analysis. 


1.  A  Renewal  Theorem  Local  in  Time 


Suppose  that  F  is  a  nonlattice  probability  distribution  with 

mean  y  >  0  and  variance  a  <  °°.  (NOTE:  An  "arithmetic"  distribution 

is  a  distribution  whose  support  is  contained  in  a  discrete  subgroup 

of  1R ;  a  "lattice"  distribution  has  support  contained  in  a  coset  of  a 

discrete  subgroup.)  Let  X-.X^,...  be  lid  from  F,  and 

S  -  X.  +  . . .  +  X  . 
n  1  n 

STONE'S  THEOREM  (Stone  [13  ])  :  Asn+» 

(1)  •UPI!|1|<1  suPxeR 

&  ICK 

In4  P(Sn  -  ny  e  I +x>  -  |lj  ^(x/n*)  | 

-*■  0  . 

Here  the  supremum  is  taken  over  all  finite  intervals  ICK  of  length 

A  2 

1 1 1  j< 1  where  K  is  a  compact  subset  of  F;  and  A  (x)  ■  (2 no 

-xW 
•  e 

Let  3  -  max  €  ,  k  a  fixed  integer,  I  a  fixed  finite 

n  „ _  n 

m>n 

interval,  and  {aQ)  a  sequence  of  real  numbers.  Define 

(2)  Fn,k,I  (dx0’”,,dxk)  "  P^XnEdx0,',”Xn-kedxkISnean  +  l1  * 


THEOREM  1:  If 

(3)  lim  0  .  Ilf1  exp{(a  -ny)2/2n a2}  -  0  , 

n-*» 

then 


3 


<*>  •••  p(dV  • 

Furthermore,  the  convergence  In  (4)  is  uniform  on  any  set 

«$  ■  {({an),I)}  of  pairs  such  that  j  x)e  j  I  is  a  bounded  subset 

of  1R,  and  such  that  the  convergence  in  (3)  is  uniform  over  J. 


PROOF:  Since 


rn,k,IWx0 . dV 


-  F(dxQ) 


...  F(dxk)p{Sn_k_1 


k 

ea  -  I  x.  +  l}/P(s  e  a  +  1} 
n  j.o  j  n  n 


9 


the  theorem  is  an  immediate  consequence  of  Stone's  Theorem.  Ill 

This  is  the  key  to  establishing  the  following  renewal  theorem. 
Recall  that 


x  -  min(n  :  S  >  a) 
a  n 


THEOREM  2: 

Let 

(8) 

nQ  -  nQ(u,a)  -  ay-1  +  \ 

then 

(9) 

P(x  -nJ  ~  e-u  a 

a  u 

and 

(10) 

p^Ta"n0*  ”alx^ 

a 

.  -»2/2  a*1  „3'2 

4 


as  a  +  ».  These  relations  are  valid  uniformly  for  x  bounded  away 


from  zero  and  u  in  any  compact  subset  of  1R ,  provided  the  oCa1'  ; 
term  in  the  definition  of  is  uniform 

PROOF:  Fix  uel  and  xe(0,°°);  let  r  e  IN  be  a  large  but  fixed 
number,  and  let  1^  *  ((j-l)x/r,  jx/r],  j*l,...,r.  Then 

(11)  p{Ta«nQ;  Sx-a<x} 


1  p{S  ea  +1. }p(t  ■  n.l S  ea  +  lJ  . 
j.l  n0  j  a  O'  nQ  j 


It  is  quite  obvious  that 

(12)  1  -  P(s  -S  0  < jx/r,  some  l,  1  <1  <nJs  ea  +  I,} 

n0  nQ~l~  0  n0  3 


<  P{t  =  n_|s  ea+I,} 

-  a  0  n0  3 

<  1  -  P(S  -  S  .  <  (j-l)x/r,  some  £,  1  <  X,  <  nn |S  Ea+I  }  . 

no  no~*  "  - 0  no  3 

In  Lemma  2  to  follow  it  will  be  shown  that  for  each  6  >  0 
there  is  a  large  enough  that 

(13)  lim  sup  max1<,< 

P{s  -  S  „  <  x,  some  l,  n.  -  k,  <  l  <  n„  Is  ea+I.)  <  €  . 

n0  n0~*'  0  1  0  no  3 


Moreover,  by  the  Strong  Law  there  is  a  k^  large  enough  that 

(14)  P{Sn£x,  some  n>_k2)  <  €  . 

Let  k  "  max(k2,k2).  Since  Theorem  1  implies 


5 


(15)  P{S  -S  „  <  a,  some  1,  1  <  S,  <  k I S  ea+I.) 

no  no“a  ~  “  “  n0  j 

P{S^  £  a,  some  l,  1  £  1  £  k) 

for  each  a  £  (O,00),  it  follows  that 
r 

(16)  Z  P(S  £a+I.}[l-P{S„  <  j  x/r,  some  £}  -  26] 

j-1  n0  J 

£  P(t  «nn;  S  -a£x} 

3  U  T 

r 

£  Z  P(S  ea +1  }[1 -P{S.  £(j  -  l)x/r,  some  £} +2£]  . 

j-1  n0  3 

Relation  (10)  follows  easily  from  this  inequality.  Stone's  Theorem 
allows  that 

2 

(17)  P(S  ea+I  )  ~  e"u  /2  a-1  \il/2  (2Tia)"1/2  •  (x/r)  ; 

n0  3 

Lemma  1  to  follow  states  that  for  all  a  £  0 

1  -  P(Sp  £  a,  some  l  £  l}  «  P(s  >  a)y/ES  ; 

T0  0 

and  €  >  0  is  arbitrary.  Thus  for  large  r,  the  two  extreme  sides  of 
the  inequality  (16)  both  approximate  the  expression  on  the  right  hand 
side  of  (10) . 

Let  be  a  compact  set  of  ]R  and  a  compact  set  of  (0,°°). 

To  establish  that  the  relation  (10)  is  valid  uniformly  over  u  e and 
xcKgt  it  is  enough  to  show  that  there  is  uniformity  in  (13),  (14), 
(15),  and  (17).  Uniformity  in  these  relations  follows  immediately 


6 


from  the  statements  of  Lemma  2,  the  Strong  Law,  Theorem  1,  and 
Stone's  Theorem,  respectively. 

To  complete  the  proof  of  the  theorem  it  suffices  to  demon¬ 
strate  that  (9)  holds  uniformly  for  u  in  compact  sets,  for  it  will 
automatically  follow  from  this  and  what  we  have  already  proved  about 
(10)  that  (10)  is  valid  uniformly  for  x  bounded  away  from  zero.  In 
the  proof  of  (9)  we  will  appeal  to  the  fact  that  (10)  holds  uniformly 
for  x  bounded  away  from  zero  and  infinity. 

Choose  €  >  0  small,  and  let  A  >  0  be  large  enough  that 

00 

Z  [l  -  F(A  +  j ) ]  <  6  . 

j=*0 

By  Stone's  Theorem  there  is  a  constant  C  >  0  such  that  for  each 
interval  I  of  length  1  and  all  a, 

P(S  .  e  I>  <  Ca-3*  . 

V1 

Now 

P(Ta«n0;  ST-a>A} 

<  jT  P(X  > A  +  z)p{s  ,  ea-dz) 

-  0  nQ  nQ-l 

00 

<  Z  [1  -F(A+j)]*Ca“Js 
3-0 

<  gCa"3*  . 

We  have  already  shown  that 
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I5v 


p{x  ■  n.;  S  -a<A}~e_U  /2  a"1  y3/2(2ira)-1/2  •  ft  P(S  > y}dy/ES  ; 
a  u  Ta  00 

since  €  >  0  is  arbitrary,  (9)  holds.  This  completes  the  proof.  Ill 


LEMMA  1:  For  any  random  walk  with  mean  y  >  0,  and  for  each  a  >  0, 
(18)  1  -  P(S  <  a  for  some  n  >  l}  =  p(s  >a}y/ES 


PROOF:  This  is  an  exercise  in  the  use  of  the  "Duality  Principle"  for 
random  walks  (cf.  Feller  [5  ],  Chapter  XII).  Let 


t  =  inf  (n  >  1  :  S  <  0} 
—  n  — 


1  -  P(S  <a,  some  n>l} 
n  —  — 


*  f  P(min  S,  >  a  -  y)F(dy) 
(a,00)  - 


-  /  E  P(  min  S  ,=  S,  >  a  -  y)p(t  =  »>F(dy) 


(a,00)  k“0  0<j<k 


j  k 


/  E  P{tn>k;  S,  >  a  -  y}F(dy)P{t  ■  °°} 

(a,~)  k-0  u  k 


p(s^  >a)p(t  *=«} 
T0 


p{ST  >  a}/ET0 


-  P(s„  >a}y/ES„  .  Ill 


8 


LEMMA  2:  Let  be  a  compact  set  of  1R  and  K„.  a  compact  set  of  (0,°°). 
Then  under  the  conditions  of  Theorem  2, 

(19)  inf  lim  sup  sup  sup  max 
k>0  a-**  u£K1  xeK2  l<j<r 

P(s  -S  .  <  x,  some  L  n„-k<J,<n  Is  ea  +  I,}  *  0  . 

no  no~*  “  0 - 0  no  j 


PROOF:  "Looking  backwards"  along  sample  paths  one  sees  that 

P{S  -S  „<x,  some  Z,  nrt  -  k  <  Z  <  n.  I S  Ea  +  I,} 
n0  0  —  —  O'  nQ  j 

£  P(S^£x,  some  Z,  k^Z^n^} 

•  P(S  ea  +  I .  |S.<x,  some  Z,  k<  Z<n  }/v{s  ea+I.}  . 

n0  J  *  0  n0  i 

By  Stone's  Theorem  and  the  definitions  of  nQ  and  1^ , 

sup  sup  max  [l/p{s  ea+I  }]  ■  0(3**) 
ueK^  xeK2  l<j<r  n0  J 

By  the  Strong  Law, 

inf  sup  P{S.  <x,  some  Z  _>  k)  ■  0  . 

k>0  xeK2 

Thus  to  prove  (19)  it  suffices  to  show  that 

(20)  sup  sup  sup  max  P{S  ea+I.  js«-y}  ■  0(a-1*) 
ueKL  xeK2  y<x  0<«,<nQ  no  J 

Relation  (20)  follows  from  Chebyshev's  Inequality  and  Stone's 
Theorem,  quite  painlessly.  For  n^  >  Z  +  log  a. 


9 


P{S  ea  +  lJSj-y} 
n0  J 

<  p{s  «  >  a  -  y} 
n0* 

£  (iIq  -  A)a^/[-y  +  Ap  -  ua  y  ^  +  o(sl*) 

-  o(a ■J*) 

u 

uniformly  for  u  e  K,  (provided  the  o(a  )  In  the  definition  of  n^ =* 
n^Cu.a)  is  uniform).  On  the  other  hand,  A  <  &  implies 

n^  -  A  >  a/2p  (for  sufficiently  large  a  and  u  E  K^) ;  Stone’s  Theorem 
implies  that 

sup  P{S  el)  *  0(n-i*) 

I: | I j <B  n 

so 

sup  sup  sup  max  P{S  ea  +  I  |s««yl  •  O^-**)  .  /// 

b+ir  nn  J  *■ 

ueK^  xeK2  y<x  0<A<a  ^  log  a 

Theorem  2  is  especially  useful  in  studying  large  deviation 

probabilities  for  hitting  times.  As  an  illustration,  we  present  an 
« 

extension  of  Cramer's  classical  estimates  for  the  one-sided  gambler's 
ruin  problem  (cf.  Feller  [5  ];  also  Siegmund  [11]). 

Let  X^.X^,...  be  i.l.d.  random  variables  from  a  distribution 
F  with  a  finite  Laplace  transform  in  some  interval:  this  distribu¬ 
tion  will  be  thought  of  as  a  member  of  an  exponential  family  of 
probability  distributions  (Fg  :  0e J),  i.e., 

10 


(21) 


F0(dx)  -  e6x-'M0)  F(dx) 


jK0) 


/  e0X  F(dx)  , 


M&) 


and  J  is  the  largest  interval  on  which  the  Laplace  transform  e 

2 

is  finite.  Denote  by  y0  and  a0  the  mean  and  variance  of  F0,  so 

(22)  y0  -  (d/d6)iK0) 


o2  -  (d2/d02)^(0)  . 


Note  that  these  simple  relations  imply  that  y0  +  ,  and  that  i^(0)  + 
on  {0  :  y0  >0)  ■  J+  but  iK0)  +  on  {0  :  y0  <  0}  =  J_  . 

THEOREM  3:  Suppose  F  is  a  nonlattice  distribution,  and  let  * 
min{n  :  S  >  a).  If  9  >  0,  0  e  J,  and  ^(0)  >  0,  then  as  a  •+■  00 


(23)  Po(Ta<a/y0 


-0a  +  I  a/yft  ]^(0)  . 

<  a/y_}  -  e  (2ira) 


o-1  U3/2  U-e-*'9’)-1 


If  0  e J+  is  in  the  interior  of  J,  and  if  ty(0)  <  0»  then  as  a  +  », 

-0a  +  I  a/y0  + 1  J\|>(0)  l 

(24)  P  {a/y0  <  t  <»}  ~  e  (2ira) 

0  t)  a 


•  o-1  v\'2  (1-e^'r1 


fT  e"0X  P/,{S  >  x}dx/EflS 

0  0  T0  6  To 


11 


Note  that  0  >  0,  \p(0)  >  0  implies  Pg  >  0,  so  the  statement 


(23)  makes  sense. 


PROOF  OF  THEOREM  3:  For  0  >  0,  0  e  J,  i|>(6)  >  0, 


P  (t  <  a/pj  *  / 

9  {va/V 


-0s  +-nK0) 

e  dP 


6 


=  e 


-0a  +  £  a/Pg  31^(9) 


I  a/y0  1 

£  / 

j=0  {Ta-j} 


-0(S-a)+(j-t  a/p„  1)^(0) 

*  T  6  "e  • 


1/3 

For  £  a/Mg  J  -  a  _<  j  <  £  a/pg  1»  the  approximation 

Pe{S^-a<x|Ta-j)  -  £  P^S^jrJdy/EgS^ 


VTa'jl  -  (Zaal^o-1  v\n 


hold  uniformly  by  Theorem  2,  so 

-0<Sx  -a)+(j-ta/pfl]W0) 


I  a/P0  J 


Z  /  e 

Ha/pfl]-a1/3  {Vj} 


dPr 


~  (2TTa)_,s  o'1  p 3/2  /”  e"6x  PD{S„  >x)dx/EftS 


0  H0  0  c  0l"xr 


0  1, 


C  a/p0  J 

£ 

j-IL  a/pg  l-a1/3 


(j-r  a/p0  1)^(6) 
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The  last  expression  Is  a  geometric  series  which  converges  to 
(1  -  e  j|  a  +  »,  Since 

I  a/M0  J-a1/3  -8(St  -a)+(j-I  a/pQ  3)^(0) 

l  f  e  &  dPfl 

J-0  (Ta-j}  0 

<  e-a1/3 

is  of  smaller  order  of  magnitude  than  a~^,  the  proof  of  (23)  is 
complete. 

The  proof  of  (24)  is  quite  similar,  but  a  technical  complica- 

-0(ST-a) 

tlon  arises:  if  6  <  0  then  e  is  an  unbounded  random  variable. 

We  will  not  reproduce  the  details  of  the  argument  here  (however,  see 
Example  1  of  Section  2,  where  essentially  the  same  problem  of  uni¬ 
formity  occurs);  we  have  included  Proposition  1  below  to  dispose  of 
uniform  lntegrabillty  difficulties  which  arise  in  the  use  of 
Theorem  3.  Ill 


PROPOSITION  1:  Suppose  g(y)  is  a  positive  nondecreasing  function  on 
[O,00),  that  F  is  a  distribution  on  E  with  finite  mean  ;i  >  0,  and 
that 


(25)  /“  4[0  co)  g(u)F(du  +  z)dz  <  »  . 


Let  {T 


a,i 


:  iel,  adt)  be  any  family  of  stopping  times  for 

,X  )}  .  0  such  that  if  T  .  ■  n,  then  S  .  <  a  <  S  . 

n  nal,2,...  a,i  *  n-1  —  —  n 


Then 
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(26)  sup  sup  E_  g(S  _  a)  <  oo  . 

iel  aeH  a,i 

If  F  has  a  finite  variance,  then 

w 

(27)  sup  sup  n  E_[g(S  -a);S  <a<S]<"  . 

_  r  n  n-i  —  n 

n  aeK 

Other  than  the  variables  T  -  min(n  :  S  >a),  many  families  of 

a  n 

random  times  are  subsumed  by  this  proposition,  for  example 
T  -  min(n  :  >  (2an)is}  ,  a  >  0 

The  condition  (25)  is  not  difficult  to  verify,  in  many  instances  of 

0  y 

interest.  If,  for  example,  g(y)  ■  e  } ,  0  >  0,  and 

(28)  /”  g(y)F(dy)  -  /”  e0y  F(Jy)  <  «  , 

then 

(29)  fo  b[o,°>)  8(u>F<du  +  y)dy 

"  £  h[0,«)  e0<U+y)  F(du+y)e"0y  dy 

±  fQ  e'9y  dy  <fe[0,-)  £0U  F(du) 


PROOF  OF  PROPOSITION  1:  Let 

(30)  G(z)  -  £e(0(CB,  g(u)F(du  +  z) 

for  z  >  0;  since  g  is  nondecreasing,  G  +.  Let 


- 1 :  iK'.’rii 


14 


by  the  renewal  theorem  there  Is  a  constant  C  such  that 

(32)  U(I)  <  C  <  ® 
for  every  interval  I  of  length  1.  But 

(33)  Ep  g(ST  -a) 

a,i 

00 

’  C  /„  g(u)F(du  +  z)  E  P(T  .  >  k,  S  ea-dz} 
u  u  kmQ  a,  x  k. 

£  /“  G(z)U(a  -  dz) 

00 

<  E  G(k  +  l)U(a  -  k  -  1,  a-k] 
k-0 


<  E  G(k  +1)  •  C 
k“0 

<  <*> 

by  (25). 

If  F  has  a  finite  variance,  then  by  either  Stone's  Theorem  or 
the  Local  Limit  Theorem  for  lattice  distributions  there  is  a  constant 
C  <  00  such  that  for  every  interval  J  of  length  1, 

sup  n**  P_{S  £j}  <  C* 

F  n  — 


Hence 


(34) 


ef[8(s„-.)i  sn.1<  =  <sn] 


00 

<  E  G(k)P_(k  <  a  -  S  ,  <k+l} 
“  k-0  F  “  n_1 ~ 


1 

<  n-^  C*  E  G(k)  .  /// 

k=0 


In  deriving  the  analogue  of  Theorem  2  for  lattice  random  walks 

Stone' 8  Theorem  may  be  replaced  by  the  more  well-known  local  limit 

theorem  for  lattice  distributions.  Although  the  argument  is  the 

same,  the  result  is  quite  different. 

Let  (S  )  be  a  random  walk  with  increments  {X.}  i.i.d.  from  F, 
n  J 

2 

which  has  mean  y  >  0  and  variance  o  <  °°.  Suppose  F  is  supported  by 
the  coset  h  +  2  ,  where  0  £  h  <  1  is  either  zero  or  irrational;  and 
suppose  there  is  no  integer  k  >  1  such  that  h  +  k*  supports  F.  Let 


(35) 


T  »  min{n  > 1  :  S  >  a } 
a  —  n 


T  -  mintn  >  1  :  S  >  0)  . 

n 


THEOREM  2*:  If 

(36)  nQ  »  nQ(u,a)  -  ay  1  +  ua  y-3^2  a1^2  +  oCa1^2) 

and  if  h  ■  0,  then  for  xr,  {1,2,...  }, 

(37)  p{Ta-nQ;  ST  -  a  -  x  -  (a  -  I  a  J) } 


-  e 


2,. 

_-u  /  2 


-1  3/2 


(2*a) 


-1/2 


PfST  >x)/F.ST 
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as  a  -*■  00 .  If  h  i*  0,  then  for  x  e  (l,2, ...  } 

(39)  P{Ta»nQ;  ST  -  a  =  x  -  (a  -  nQh  -  [  a  -  nQh  1)  } 


and 

(40) 


e"U  72  a"1  y3/2  (2Tta)“1/2  (ES^.)-1 


P(ST  >x-  (a  - nQh  -  £  a  -  nQh  3)} 


P(t  =n  )  -  e~u  72  a-1  y372  (2ira)“172  (ES  )-1 
a  0  l 


00 

•  Z  p{st  >x  -  (a -nQh  -  [  a -nQh  3)  } 
x=l 

as  a  -*■  00 .  These  relations  ((37)-(40))  hold  uniformly  for  u  in  any 

h 

compact  subset  of  1R  ,  provided  the  o(a  )  term  in  the  definition  of 
n^  is  uniform. 

-1  -1  3/2  -1/2 

The  surprise  is  (40) :  for  although  (x  -  ay  )cr  y  a 

is  (asymptotically)  normally  distributed,  the  (asymptotic)  density  of 

x  is  not  the  discretized  normal  density.  However,  one  may  easily 
a 

deduce  the  global  limit  theorem  from  (40)  by  appealing  to  Weyl's 
equidistribution  theorem  of  number  theory  (see,  for  example, 
Chandrasekharan  [4  ]). 


Now  suppose  that  in  addition  to  having  support  contained  in 
h  +  I  (and  in  no  coarser  lattice)  F  has  a  Laplace  transform  which  is 


finite  in  some  open  interval  J  containing  zero.  As  before,  let 


_  ,,  .  0x-iij(0)  . 

Fg(dx)  =  e  y  F(dx) 


B*(e)  =  e0x  F(dx) 


y0  =  ;]R  X  F0  (dx) 


4  m  ^  (x-we)2  F0(dx) 


J+  -  {0  e  J  :  yQ  >0}  . 

THEOREM  3  :  Suppose  h  *  0.  If  0  >  0,  0  £ J,  and  1 p(8)  >  0,  then  as 
a  -*■  00  through  Z 


(41)  Po{xa<au0}  ~  e 


-0a  +  I  a/y0  3^(0) 


•  (2ira) 


-1/2 


a’1  p2'2  CL-r^V1 


I  e-8x  P  {S  >«}/e6s  . 

X=1 


If  9  e  J+  is  interior  to  J  and  ip(Q)  <  0,  then  as  a  -+■ 

-0a  +  Ia/Mfl  +  lj^(0)  . /9 

(42)  Pn(a/yQ  <  t  <  »}  ~  e  •  (2ira)~  ' 

u  o  a 


Suppose  h  t*  0.  If  8  >  0,  8  e  J,  and  i(»(0)  >  0,  then  as  a  +  « 


through  K  , 


(43)  P 


-0a  +  [  a/yfi  3i^(0)  . 

{t  <aMfl)  ~  e  0  *  (2Tra)-1/2 


0  a—  H0 


‘“e1  vl,2/hsT> 


Z  Z  Pg{ST  >^x  -  (a  -  jh  -  It  a  -  jh  3)} 
j-1  x-1 

exp{-8[x  -  (a  -  jh  -  I  a  -  jh  3)  ] 

+  (j  -  I  a/uft  3)^(6)}  • 


If  0  e  J+  is  interior  to  J  and  t|>(0)  <  0,  then  as  a  +  “  through  R 

-0a  +  Ia/yfi+UiK0)  _1/? 

(44)  PQ{a/y0  <  < »}  -  e  (2ua) 


•  tog1  W0/2/BesT) 


j*I  a/yQ+]3  x-1 


Z  P  {S _>x- (a-jh-Ia-jh  3)} 


exp(-  0[x-(a-jh-ta-jh  3)] 


+  (J-Ia/y0  3)V»(6)} 


Although  the  series  in  (43)  and  (44)  have  a  somewhat  menacing 
aspect,  they  are  "subgeometric":  to  obtain  reasonable  approximations 
one  would  need  only  a  small  number  of  terms. 
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2.  Perturbed  Renewal  Processes 


In  recent  years  an  extension  of  the  renewal  theory  for  random 
walks  to  a  class  of  "perturbed"  random  walks  has  been  effected 
(principally  by  M.  Woodroofe  ([14])  and  T.  L.  Lai  and  D.  Siegmund 
([7],  [8]));  the  germination  of  this  new  theory  was  triggered  by  the 
peculiar  needs  of  sequential  analysis.  It  is  the  object  of  this  sec¬ 
tion  to  derive  analogues  of  Theorem  2  appropriate  for  the  more  gen¬ 
eral  setting  of  Lai  and  Siegmund's  papers. 

Let  {X^}  be  iid  from  a  nonlattice  distribution  F  with  mean 
2 

p  >  0,  variance  o  ,  and  finite  third  moment,  and  S  =  X,  + . . .  +X 
’  n  1  n 

(the  need  for  a  third  moment  stems  from  the  necessity  of  appealing  to 
certain  refinements  of  the  Central  Limit  Theorem).  Let 


Z  =  S  +  £ 
n  n  *n 


T  =  T  =  min{n  :  Z  >  a}  ; 
a  n 


here  {£^1  is  a  sequence  of  random  variables  such  that  £n  is  indepen¬ 
dent  of  the  future  a(Xn+^,Xn+2> • • •  ).  Certain  assumptions  on  the 
rate  of  growth  and  oscillation  of  the  sequence  are  necessary  to 

obtain  any  results  of  a  renewal-theoretic  character:  those  that  fol¬ 
low  are  of  necessity  more  stringent  than  those  of  Lai  and  Siegmund, 
since  more  refined  limit  theorems  are  at  stake. 


ASSUMPTIONS  ON  {£  }.  There  exist  constants  ne(0,l/4),  8e[0,l),  y  >  0 
n 

such  that  for  every  €  >  0 


A.  P{  max  |C  |  >ru6"1(l-6-Y)}  =  o(r"1/4 +n/2) 

0<n<r  n 

B.  P{  max  |C  |  >r1/2+n  €}  =  o (r~1/4  +  n/2) 

8r<n_<r  n 

C.  P(|£rl  >r1/4+rl/2  €}  =  0(r~1/2) 


D.  P{ 


l<k<r 


max 
*5  +  n 


l5r-W>6l-|><t‘1/2> 


Roughly  speaking,  (A)  and  (B)  guarantee  that  T  is  not  very 

a 

much  smaller  than  its  expectation  with  any  appreciable  probability 
(see  Lemma  3);  (C)  insures  that  the  normal  approximation  to  the  dis¬ 
tribution  of  is  sufficiently  sharp;  and  (D)  implies  that  the  pro¬ 

cess  {Z  }  acts  like  a  random  walk  for  reasonable  stretches  of  time, 
n 

Not  all  interesting  processes  are  ruled  out  by  these  assumptions,  as 
the  next  result  shows. 


PROPOSITION  2.  Suppose  S  =  Y-  +  . . .  +  Y  is  a  p-dimensional  random 

n  1  n 

walk  whose  increments  {Y^  }  are  iid  from  a  distribution  with  mean 

vector  p  and  finite  absolute  2&-th  moment,  for  some  l  >  2.  Let  (a  } 

n 

be  a  sequence  of  constants  for  which  max  3/4 lan  “  an+k I  ^ and  ^et 

3  k-n  /  n  n 

g  :  Er  R  be  a  function  which  is  CJ  in  a  neighborhood  of  p  and 
satisfies 


(46) 


max  |g(x) j  =  0(R  ; 
I  x  I  <R 


as  R  +  If 
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cn  =  zn  -  ns(y)  -<Sn-ny|^(u)>  ,  ] 

then  {Cn)  satisfies  Assumptions  (A)-(D),  for  any  r|e(0,l/16)  and  j 

Be  (0,1).  }>] 

I': 

PROOF.  The  appropriate  tool  is  S.  Nagaev's  generalization  of  j’ 

k 

Chebyshev's  inequality  (this  is  Corollary  2  of  [10],  a  paper  which 

\* 

contains  a  wealth  of  information  concerning  the  accuracy  of  the  nor- 

* 

mal  approximation,  including  an  improvement  of  the  Berry-Esseen 

Theorem  which  will  be  used  later  in  this  section).  Nagaev's  ! 

Inequality  states  that  if  are  iid  random  variables  with 

zero  mean  and  if  W  =  V-  +  . . .  +  V  ,  then 
n  1  n 

(47)  P{Wn  >x)  <Bm  ElVjJ®  n/x“ 

for  all  x  >  4{n  max^.log^”1^2  -  ^/K  E|v..  l”1))}1^2  where 

m  i 

K  -  1  +  (m  +  l)(m+2)  e_m  , 
m 

and  B^  is  an  absolute  constant  depending  only  on  m.  Using  (47) 

(with  m^S)  in  conjunction  with  Taylor's  Theorem,  one  may  easily  show 
that  {^}  satisfies  Assumption  (C)  . 

Assumption  (D)  is  somewhat  stickier.  Nagaev's  Inequality 

j 

i 


shows  that  for  each  6  >  0, 


(48)  P{  max  |s  -nyj  >n6)  -  o(r-*^2) 

8r<n<r  n 

and  on  the  complementary  event 

(49>  ISn-SjH*!-  U2n>~\Sn-nM|  V2  g(y)|Sn-ny^ 

-  (2(n+k))-1  <Sn+k  -  (n+k)y|  v2  g(y)  |Sn+k  -  (n +k)y^| 

+  otn{  |Sn/n-  y  |3  +  |Sn+k/ (n  +k)  -  y  |3} 

+  o(l) 

for  some  constant  a  >  0  (this  follows  from  Taylor's  Theorem  and  the 
fact  that  the  sequence  {aR}  is  slowly  varying) .  The  cubic  term  falls 
easily  to  (47)  (with  m*4),  and 

(50)  |  (2n)_1<Sn  -  ny  |  v2  g(y)  |Sn  -  ny> 

-  (2(n  +  k)_1^n+k- (n+k)y  |  v2  g(y)  |Sn+k  -  (n +k)y^| 

<  |[(2n)'1-(2(n+k))"1l<Sn-ny|V2  g(y)  |Sn  -  n£>  | 

+  l^n+k"Sn'kyl  V  8(P>IVn-y)l 
+  l<^n+k-Sn-k|il''2  ®(l,)lSa+k-S„-kl,>/2"l  • 

The  first  and  third  terms  may  be  easily  disposed  of  by  using  (47) 

(m  ■  4) ;  (47)  also  works  on  the  second  term,  but  only  after  a  maximal 
inequality  has  been  employed.  The  proper  maximal  inequality  may  be 
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stated  as  follows:  if  are  iid  random  variables  with  mean 

zero  and  finite  variance,  then  there  is  a  c  >  0  such  that  for  all 

€  >  0, 

P{  max  (U.  +  ...  +  U.  )  >  6)  <  cP{(U,  +  ...  +U  )  >€}  . 

l<k<n  in 

Assumptions  (A)  and  (B)  are  relatively  easy  to  verify,  using 

2 

the  standard  maximal  inequality  for  L  reverse  martingales,  and 
Taylor's  Theorem.  For  (A)  some  caution  is  necessary  since  for  n 
small,  P{|Sn-ny|  >n6}  need  not  be  small;  this  is  the  reason  for  the 
2k-th  moment  condition  and  the  growth  condition  on  g.  Because  the 
details  of  the  verification  are  somewhat  mundane,  they  are  omitted. 

The  main  result  of  this  section  is  that  the  "local"  renewal 
theorem  generalizes  to  perturbed  random  walks. 

THEOREM  4.  Suppose  the  sequence  {£^}  satisfies  Assumptions  1  and  2, 

and  that  Z  «  S  +  £  ,  where  {S  }  is  a  random  walk  from  a  nonlattice 
n  n  n  n 

2 

distribution  with  mean  p  >  0,  variance  0  ,  and  finite  absolute  third 
moment .  Let 

(51)  nQ  -  ng(u,a)  -  ap-^  +  uOp  3^2  a^2  +  o(a^2) 

Then 

(52)  P(T  -nn}  ~  e“u  ,2  0-1  p3/2  (27ra)~1/2 

a  <J 

and 
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(53)  P(Ta-n0;  ZT-a<x} 


~  e~u  /2  a-1  y3/2  (2ira)“1/2  J?  p{s  >y}dy/ES 

T0  T0 


as  a  +  ®,  These  relations  are  valid  uniformly  for  u  eK^,  x  eK^, 

where  is  a  compact  subset  of  ]R  and  Kj  c  (0,<») ,  0  t  K provided 
1/2 

the  o(a  )  term  in  the  definition  of  n^  is  uniform. 

One  could  attempt  to  prove  Theorem  4  by  following  the  pattern 
established  in  the  proof  of  Theorem  2;  however,  many  of  the  technical 
details  can  be  sidestepped  by  incorporating  the  result  of  Theorem  2 
into  the  proof.  This  is  accomplished  by  first  conditioning  on 


(54) 


.X 


where 

,  .  _  -1  1/2  +n  -» 

n1  =  n^a)  =  [  ay  -a  1 J  . 

Because  of  Assumptions  (A)  and  (B) ,  T  >  n, (a)  with  preponderant 

probability  (cf.  Lemma  3  to  follow);  on  the  other  hand.  Assumption 

(D)  guarantees  that  max  .  .  |£  -E  I  is  small,  so  conditional  on 

nl<n!n0  1  n  ■  ’ 

3n  ,  Tfi  is  nearly  always  the  same  as  n^  +  min{n^l  :  >  a  -  Z^  },  and 

Z,j,  -  a  is  approximately  ST  -  (a  -  £  ) .  Thus  Theorem  2  should  allow 
a  a  nl 

for  calculation  of 

(55)  p{T  «n  ;  Z  -a<x|3  }  . 

a  u  T  —  n^ 


The  remainder  of  the  proof  will  consist  of  integrating  out 

the  conditional  probability  over  the  j-algebra  3  ,  i.e.,  evaluating 

nl 
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I 


E[P{Ta«n0;  ZT-a<x|3n  }]  . 

The  conditional  probability  (55)  is  of  appreciable  size  only  when  Z 

nl 

is  in  a  certain  interval  whose  length  is  roughly  proportional  to 

al/4  +n/2  in  turn  proportional  to  the  standard  deviation  of 

S  -  S  ) .  On  this  interval  S  has  (approximately)  a  density  which 
no  nl  nl 

is  (approximately)  a  constant  multiple  of  Lebesgue  measure  (by 

Stone's  Local  Limit  Theorem  ;  Assumption  (C)  insures  that  integrating 

out  against  S  is  not  markedly  different  from  integrating  out  against 
nl 

Z  )• 
nl 

The  strategy  of  the  proof  is  indicated  schematically  by 
Figure  Al. 


LEMMA  3.  Suppose  {Z^},  {S^} ,  and  satisfy  the  conditions  of 

Theorem  4.  Let  G  >  0,  b  >  0  be  fixed  real  numbers,  and  suppose  J  is 

3 

any  interval  satisfying 


(56) 


|jal  1  b* 


1/4  +n/2 


and 

(57)  (a-x  )  >  €  a1/2+n 

3 


where 


x  »  sup  {x  :  x  E  J  } 
a  a 


Then 


(58) 


Z  EJ  }  - 
n^  a 


at.-1'4  +n/2, 
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as  a  This  holds  uniformly  for  the  family  { J  }  of  all 

3. 

satisfying  (56)  and  (57) . 


PROOF.  This  is  essentially  the  same  as  the  proof  of  Lemma 
perturbation  terms  are  the  only  complicating  factor. 

Let 


1^  *  {y  e  1R  :  dist  (y,I)  ^6} 


for  each  interval  I  c]R,  and  let  be  the  events 

r.  *  {  max  |£  l  £a(l-B-Y)) 

O<n<0n. 


r.  -  {  max  |£  |  <  a1/2  +n  6/2} 


2  '  .  .  ' 'n' 


r  «=  (|£  |<a1/4+n/2}  . 


Then  by  assumptions  (A)-(C)  on  (6^), 

p(n  \(T1  nr2  nr3)}  -  o(a"lM  +n/2)  , 


since  n^  *  n^(a)  -  ap  Now 


{Ta-nl;  Zn,  eJa5  P1  nr2  nIV 


,  „  1/2  +  n/2 .  l/4  +  n/2 

c;  {  min  S-S<-€a  /  2  +  a  ; 


8  <n<n.  nl  n 

nl  1 


intervals 


2:  the 


28 


S°1  E  (Ja>4alA+n/2} 


U{  max  S  >a(g+Y);  S  e  (J  )  1/A.n/7>  . 

0<n<$  n  ni  a  4«1/4  +n/2 

“l 

The  probabilities  of  the  two  events  on  the  RHS  of  this  last  relation 
may  be  bounded  using  the  Strong  Law,  Chebyshev's  Inequality,  and 
Stone's  Theorem,  in  much  the  same  fashion  as  in  the  proof  of 
Lemma  2.  /// 

Lemma  3  will  justify  conditioning  on  3^  ,  effectively  allow¬ 
ing  us  to  replace  T  by  min{n  >n,  :  Z  >a}.  This  was  the  first  step 
a  1  n 

in  the  strategy;  the  second  was  to  integrate  out  over  3  .  The  next 

nl 

lemma  provides  a  device  for  doing  so.  Recall  that 

nQ(u,a)  =  ap  1  +  a^2a)j"^2  *u  +  o(a^2) 


n^a)  *  |[ay  1-a1/,2+nJ  ; 


def ine 


(59)  k  ■  k(u,a)  ■  ng(u,a)  - n^(a)  ■  a^+ri-a^20li  ^2  u+o(a^2) 


LEMMA  A.  Let  f  :  3R  -*■  1R  be  a  bounded  uniformly  continuous  function 


such  that  /  ^  |f(x)|dx<°°.  Let 


0)(y)  -  [k-  (a-y)y_1]p  k'1/2 


let  A  <  B  be  any  two  real  numbers  (finite);  and  let  (a  ),  {&  }  be 

n  n 

sequences  of  constants  converging  to  zero.  Then  if  {S^},  (£n) ,  and 
(Zn)  satisfy  the  hypotheses  of  Theorem  A, 
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(61)  J  1  f(co(y))P(Z  edy} 

(o(y)*A4a  1 

nl 

f®  r/  -u2/2  1/2  .1/2  . -1/2  -1 

~  f((o)do)  •  e  y  k  (27ia)  0 

•u*A 

as  a  +  «.  This  holds  uniformly  for  u  in  a  bounded  subset  of  IR, 

1/2 

provided  the  o(a  )  term  in  the  definition  of  ng(u,a)  is  uniform. 

PROOF.  This  is  a  consequence  of  Stone's  Local  Limit  Theorem  for  the 
random  walk  ,  together  with  Assumption  (C)  .  Let  4>(  •)  be  the 
modulus  of  continuity  of  f,  i.e., 

1K6)  *  sup  J  f  (u)  -  f  (v)  |  , 

u,v: |u-v|<6 

and  let  be  the  event 

'  {l{nJi6kl/2)  ' 


Now 


fB+£n-6 
j(y)*A4a  +6 

tl 

fB+8 


fB+6  - 

n  [f(<u)  -i|;(fi)]  P  (S  edy;  I7,} 

•w(y)*A4a  +6  1 


'<u(y)-A+a 


f(«(y))  P  *Z  edy;  r,} 

ll- 


fB+6  H 
<  " 

•Wy)- 


B+e  +6 

[ f (to)  +7K 6)]  P  {s  edy; 
(y)«A+a  -6  nl 


By  assumption  (C),  P{n\fg}  ■  o(a  since  f  is  bounded. 


-ft  |g  — ^ 

nl  [f(<»)  -4»<6)  ]  P  (S  edy}  +  o(a"1/4  +n/2) 

u(y)-A+a  -HS  nl 


< 


rB+6 

nl  f(0)(y))  P  (Z  edy} 
u(y)«A+a  nl 

nl 


(-B+B  +6 

<  ”l  [f  (a>(y))  -  ij>(6)  ]  P  (S  edy} 

4)(y)-A-Kx  _(5  nl 


o(a-1^  +n/2) 


The  integrals  on  the  extreme  sides  of  the  last  inequality  may  be 
approximated  using  Stone’s  Theorem.  Since  6  >  0  was  arbitrary,  (61) 
follows:  the  uniformity  in  u  follows  directly  from  the  statement  of 

Stone's  Theorem.  Ill 

Recall  that  the  strategy  for  evaluating  P(T  -n  (u,a); 

3  U 

ZT~a£x}  called  for  a  careful  analysis  of 

P{Tfl -nQ(u,a);  ZT~a<x;  T^n^a);  Z n  el(a,u)} 

where  I(a,u)  is  some  "critical  interval"  (see  Figure  1).  Implemen¬ 
tation  of  this  strategy  requires  that  we  bound  P(T"nQ;  ZT~a£x; 

Z  ^I(a,u)};  since  there  is  no  local  limit  theorem  (or  Berry  Esseen 
nl 

bound)  available  (a  priori)  for  the  process  {Z^},  this  is  a  somewhat 
delicate  point. 


LEMMA  5.  Suppose  the  processes  (S^,  (C^},  and  { Z^ }  satisfy  the 
hypotheses  of  Theorem  4.  Then  for  bounded  sets  KcR,  and  each 
B  >  4  +  b. 
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(62)  sup  sup 
I : I I 1 <b  ueK 


a1/2  P(Z  -n  UEI;  |z  -Z  -  (n  -  n  )p  j  >  a1/4 +n/2  B> 
n .  0  n  a  0  1 


‘0  “1 


where 


<  C(p,0,ra  )  E  (2  +b)[i(B  +  2  j  (b  +1))  +  (B  -  A  +  j(b  +  2) ) ] 

j-o 


+  a1/2p(|r,  |>a1/4+n/2} 

nl 


+  &  '  p{|£  - e;  |  > i} 

no  ni 


4>ct(x)  *  e-x  ^2°  / *^2rr  o 


Here  C(vJ,o,m^)  Is  a  constant  depending  only  on  the  first  three 

moments  of  S^f  and  the  supremum  is  over  real  intervals  I.  In  addi- 

* 

tion  there  are  constants  C,  (depending  on  b,K  and  on  the  processes 

D  ^  K 

(S  ),  {£  })  such  that 
n  n 

1/2  i-  * 

(63)  sup  sup  sup  a  PiZ  -n.pc  1)  <  C  ; 

a«»  ueK  1 :  1 1 1  <b  °0  U  b,K 


and  for  each  B  <  00  there  is  a  constant  C  such  that 

o .  K 


12 


(64)  11m  sup  sup  sup 

a-*°°  ueK  I:|l|£6 


a1/2  P(Z  -nnyel;|z  -Z  -  (n  -  n.  )\i  |  <  a1'  "  1  ‘  B; 

“o  U  nQ  ni  U  X 


1/4  +n/2 


K  li6  a1/4+n/2;  k  -t  |  <«) 


no  nl 


** 


-  S,K 


for  sufficiently  small  6  >  0. 


NOTE:  The  notation  suPuGK  '"y  be  somewhat  confusing,  since  u  does 
not  explicitly  appear  in  any  of  the  expressions.  However,  recall 
that  n^  is  defined  as  an  integer  such  that 

nQ(u,a)  «  ap-1  +  a  ^2oy  3^2  •  u  +  o(a^2) 

Implicit  in  the  inequalities  ( 59) — ( 61)  Is  the  assumption  that  the 
1/2 

o(a  )  term  is  uniform  for  u£K. 

The  proof  of  the  lemma  will  rely  on  a  strengthening  of  the 
Berry-Esseen  Theorem  due  to  Nagaev  [10]. 

NAGAEV'S  NORMAL  APPROXIMATION  THEOREM.  Let  U  -  Y,  +...  +Y  where 

n  1  n 

Y^,...  are  i.i.d.  random  variables  with  mean  zero,  variance  1,  and 
finite  absolute  third  moment  m^.  Then 

(pfu^  <m^2)  -  Hx)  I  ±Lm3n  ^2(l  +  jx|2)  ^ 

for  every  neIN  and  xcIR  .  L  is  a  universal  constant. 
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PROOF  OF  LEMMA  4.  Let 


1^  *  {y  E  IR  :  dist  (y,I)  <■  5} 


k  =  no  "ni  “  +f>  +  uay“3^2  a1^2  +  o(a^2) 


Then 


(65)  P(Z  -  n  pc  I;  |Z  -  Z  -ky|  >k1/2  B;  |E  |  <k1/2;  |£  -E  |  <l) 
0  0  1  nl  n0  nl 


<  FtSno-  X+1i  |Sn<-  Sni-kM|  >k1/2  B-  1;  Ic^l  <ki/2i 


l/2i 


=  I  P{St  -ky  e I+1  -y;  |S^-kyj  >  k1/2B-  l} 


P{Sn1+Cni-”l',Ed>'' 


<  l  P(B-  1  +2j(b+l)  <  |S  -ky  !k"1/2  <B -1  +2(j+l)  (b+1)} 
j=0  R 

•  P(S  -n.y  ek1/2  J(j,I)} 
nl  1 

where  for  each  j,  J(j,I)  is  the  union  of  two  intervals  whose  lengths 
do  not  exceed  4(b+l).  By  the  (usual)  Berry-Esseen  Theorem  there  is 
a  constant  C*(o,m.j)  such  that 

P{Sn1~nlU£kl/2  J}  -  (kI/2/nJ/2)(|jl  +l)C*(a,m3) 

for  all  intervals  J  and  all  a  >  0  (and  uniformly  for  u  E  K,  since 
k  -  k(u,a)  t  «  uniformly  as  a  t  ®) ,  The  probabilities 
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m 


P(B  -1  +2j(b  +1)<  jsk-  ky|k_1/2  <  B  -  1+  2(j  +l)(b  +1)} 


may  now  be  estimated  using  Nagaev's  Theorem  to  complete  the  proof  of 
(62):  again,  the  fact  that  ueK  (bounded)  implies  that  k  =  k(u,a)  f°° 
uniformly  for  ucK,  so  the  bound  provided  by  Nagaev's  Theorem  is 
uniform  in  u. 

By  Assumptions  (C)  and  (D)  on  the  process  {£  }, 


1/2 


P(|C 


>ai/4+n/2} 


a1/2  P{  |  £  -  £  |  >1}  0 

no  nl 


Thus  in  view  of  (62)  it  suffices  to  show  that  p{z  -n.yel; 

nQ  ^ 

|z„  -  Z_  -kyl^k"^2  B;  f}  *  0(a  ^2)  in  order  to  prove  (63): 


no  nl 


here 


r  -  {l?n  I  la1/4  +n/2J  n  (|£  -£  1  <  1) . 


n0  nl 


Now 


(66)  p{z  -n.yel;  |z  -Z  -  ky  I  <  k1/2  B;  T} 
n0  0  n0  nl 


<  P(S  -n.y  +  £  el..;|s  -S  -  ky  |  <  k1/2  B  +  1;  T) 

~  n0  0  nx  +1*  nQ  ^ 


=  I  P(Sk  -ky  e  I 

•  P(S  +£ 
n. 


+1 


-y;  |sfc-  ky|  <  k1/2B  +1} 
-  n^y  G  dy;  T }  . 


By  the  Berry-Esseen  Theorem  there  is  a  constant  C  such  that 


— - -  ' 
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(67) 


P{Sk-kp  e  I+1  -  y}  <  C*(|l|  +  2)k“1/2 


P(S  +£  -n.y  £k1/2  J;  D  <  C*(|j|  +3)k1/2/nJ-/2 
1  1 

for  all  intervals  I  and  J  (on  T,  |£  /k^2|_<l);  furthermore, 

nl 

(y  :  I+^  -y  H  [-k^2  B-  1,  k"^2  B+l]  ^  4>]  is  an  interval  of  length  no 
greater  than  2k^2  B+4  +  |l|.  Hence  (63)  follows  from  (66)  and 

(67) .  (Uniformity  in  u  again  follows  from  the  fact  that 
k  =  k(u,a)  +  00  uniformly,  provided  u  eK  bounded.) 

The  proof  of  (64)  is  quite  similar.  /// 

PROOF  OF  THEOREM  4.  Fix  B  >  0  and  6  >  0  (B  should  be  thought  of  as 
being  quite  large,  so  that  the  RHS  of  (62)  is  small,  and  6  should  be 
thought  of  as  small) .  Recall  the  notation 

k  =  k(u,a)  «  nQ(u,a)  -n^a)  =  a1^2  +  ri  +  a ^2  oy"^2  u+o(a1,/2)  , 

and  let 

r.  -  (|5  |  < 6k1/2} 

o  1  n^ '  — 

G.  =  {  max  |C  -  5  |  <  6) 

o  .  .  '  n  n,  1  — 

n1lnin  ■)  1 

Then 

(68)  P{Ta*nQ;  ZT~a£x} 

±P(VV  l\-Z„1-klIliBkl/2-  P6’  GS> 
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_ ____ _ _  ■-  -.t-rVW  ■  -  ■-  ,t  ■ 


+  p{z  e  (a, a  +x];  Iz  -Z  -kyl>Bk1/2} 
n0  n0  nl 

+  P{V 

+  PfG^}  . 


According  to  assumptions  (C)  and  (D) ,  the  last  two  probabilities  are 
o(a~1/2);  and  P{Z  e(a,a+x];  jZ  -Z  -ky|  >Bk1/2}  will  be  small 

0  no  ni 

in  comparison  to  the  first  probability  if  B  is  large  (cf.  (62)). 

Thus  it  is  the  first  probability  that  is  of  primary  interest. 

Begin  with  the  inequality 


(69) 


/•a-ky+Bk  -x 

,  P(T  =n  ;  6<  Z  -a<  x;  GjZ  -  y;  T  >  n. ;  T.J 
Jy=a-ky-Bk^+x  a  0  T  “  6  ni  16 


p{zn1Edy;  T>"1;r6) 


i  P(Ta -nn;  ZT-S<  x;  |zn  -  Z_  -  ku|  <Bk1/2;  F, ;  G- ] 


no  nl 


'a-ky+Bk*+x 

i  P{T  1  =  n  ;  6  <  Z  -  a  <  x;  G.  ] Z  » y;  T >  n, ;  T.) 

y”a-ky-Bk  -x  a  0  T  “  6  nl  16 


•  PfZ^edy;  T>„i:r{} 


+  P{a  <  Z^  +6;  Iz^  -  -  kw  |  <  Bk1/2;  r{!  G{)  . 

It  follows  from  (64)  that  if  6  >  0  is  small,  then  p(a  <  Z  <a+6; 

|  Zr  -  Z^  -ky|j<Bk^2;  Gg}  is  small  compared  to  the  integrals  on 
the  extreme  sides  of  the  inequality  (69)  (recall  that  k^2~a^^+r|^2 
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wjafoftA* 


and  that  u  is  restricted  to  the  bounded  set  K) .  Thus  the  bulk  of  the 
argument  consists  of  approximating  the  integrals  in  (69) . 

Theorem  2  is  the  key  to  evaluating  the  conditional 
probabilities:  the  reduction  to  the  framework  of  an  unperturbed 
process  is  provided  by  the  obvious  inequalities 

(70)  P(xa  =n0 -n1  =  k;  ST  -  a  +y  +$  e  (26  ,x]}  ‘lfl^;  Ta  >n^} 

<  P(Ta  =nQ;  6  <  a  <  x;  1  Zn  =  y;  >nx;  rfi)  •  l{rg;  Tg  5-n^ 

<p(t  >»n--n1“k;  S  -a+y<x+<5}  *  l(r.;  T  >  n1 } 

—  a-y  0  1  T  —  o  a  1 

where  *  min(j  >;1  :  >b).  Since  k  ~a^2  +T1  t  00  Theorem  2  provides 

asymptotic  approximations  to  the  probabilities  on  the  extreme  sides 

1/2  1/2 

of  (70);  moreover,  since  a-ky-Bk  -  x  £y  £a  -  ky +Bk  +x,  these 
approximations  are  uniform  on  the  range  of  integration.  Thus  for 
large  a, 

(71)  e-<o(y)  ,2°  a-1  y(2Trk)~1/2[/7x,  P{S  >s}ds/ES  -6] 

T0  0 


l{r»;  T  > n, } 
o  a  1 


<p{T  *  n„;  6  <  Z„  -  a  <  x;  G*  I Z  ■  y;  T  >0,;  IX} 
—  a  0  T  —  o'  n^  a  1  o 


•  1{IV  Ta  >nl} 


<  e”“(y)  /2°2  o’l  y(2TTk)"l/2[ rx+6  P{S  >s)ds/ES  +6] 

0  T0  0 


i(rx 


W 


«  y'rt-  •  “Ith'ipur  i-i  '  r  f  j’lfT'  ' 


X 
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where 


(72) 


<»(y)  "  [k-  (a -yJu-1]^-1^2 


for  all  <ii  m  <o(y)  such  that  aie[-B-xk  ^2,  B+xk-^2]. 
Combining  (69)  and  (71)  gives 

-JS 


cB-xk 


l2,-_2 


(73)  |  e-to(y)  /2°  p(Zn  edy;  rfi;  Tfi  >0^ 


;w(y)*-B4xk 


-5j 


•  (27rk)"1/2  o-1  y  •  [jf..  p{s  > s)ds/ES  -6] 

0  T0 


-P{Ta‘n0;  ZT“a±x;  lZn  "Zn1'ky|-Bkl/2;  G6;  r 


<  f  .  e"“(y)  ,2°  P(Z  edy;  T-;  T  >n  } 


-h 


.  2  ,„_2 


J(u(y)“  -B-xk 


(2irk)— X^2  0— 1  y  •  [/f*5  PCs  >s)ds/ES  +6] 

0  To  To 


+  P(a  <  Z  <a  +6;  |Z  -Z  -ky|<Bk1/2;  r,;  G*} 
n0-  no  nl  ’  S’  6 


Recall  that  P{l\.}  -  o(a  ^2) ,  and  that 


P(T  >n, ;  Z  -a +ky  e  f- Bk1/2- x,  Bk1/2  +  x]} 
a  X  n^ 


o(a-1/4  +ri/2) 


-  o((k/a)1/2) 
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(by  Lemma  3;  note  that  for  ueR  bounded,  k  *  k(u,a)  ~  a^2  +ri 
uniformly,  so  (57)  holds) .  Consequently,  the  measures 

P{Z  edy;  T  >  n,  } 
n^  3  o’  a  1 

may  be  replaced  by  P{Z  edy).  Lemma  4  now  applies;  thus 

nl 

for  large  a 

(74 )  [f\  e-a)2/2a  daj/(2ir)1/2  o]  •  y3/2(2TTa)~1/2  e-u  /2  a-1 

"O 

•  [/*  p(S  >s)ds/ES  -26] 

0  0 

<  P(T  =n„;  Z_  -  a  <  x;  |Z  -Z  -ky|<Bk1/2;  Gx ;  r.) 

—  a  0  T  —  1  n^  n^  1  —  *66 

<  [A  e-“2/2°2  d»/(2,)1/2  o]  •  ,3/2(2.a)-l/2  o'1 

“D 

•  t/X+<5  P(s  >  s}ds/ES  +26] 

°  T0  T0 

+  P(a  <  Z  <a  +6;  |Z  -Z  -kyl<Bk1/2;  I\;  G,}  . 

-  n0-  '  n0  nl  6*  6 

Letting  6  10  and  then  B  +  00  proves  (53) . 

A  careful  examination  of  the  argument  will  reveal  that  (53) 
holds  uniformly  for  ueK  and  xeK',  where  K  is  a  bounded  subset  of  IR 
and  K'  is  a  compact  subset  of  (O,00).  The  proof  of  (52)  is  all  that 
remains:  it  will  be  accomplished  by  the  same  device  as  the  proof  of 
(9)  in  Theorem  2.  Choose  €  >  0;  let  x  be  large  enough  that 
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C  P{ST  >yJdy/Es_  <  € 

x  To  o 


Z  p{)L  >x  +j  -l)  <  € 
J-0 


For  sufficiently  large  a, 


P(T  -n  ;  Z  -a  <  x)  -  e“u  /2  a-1  y3/2 (2TTa)"1/2 
a  0  i  — 


•  [/X  P(S  >y}dy/ES  ± €j 
U  0  0 


and  by  (63)  of  Lemma  5 


supI :  1 1 1  <_2  a  P{Zn0-l~(nO  1)yEl^-C2,K 


provided  ueK,  a  bounded  subset  of  !R.  By  assumption  (D) , 


a1/2  P{|€  .  {  >1}  <  € 

no  V1 


Since 

HW  ZT-a>x) 

00 

<  Z  p{x.  >x+j  +l}p{a  -2j  >Z  >a  -  2 j  -2)  +  p(|£  -t 
j-0  0  0 

It  follows  that 

2 

P(T  - n.)  -  e‘U  /2  a-1  M3/2(27ra)"1/2[l  ±2€]  ±  €(C*  +l)a 

&  U 

uniformly  for  ueK.  Since  €  >  0  was  arbitrary,  (52)  follows 
completes  the  proof  of  the  Theorem.  Ill 


D  . 

0 

1/2 

This 
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EXAMPLE.  Suppose  that  Y^.Y^,... 


and 


(75) 


are  i.i.d.  h(y,l),  Un  -  Y , 
T  »  min(n  :  U2  >  2an) 


Let  t  >  0  be  fixed;  if  p  >  (2/t)1/2,  then 


(76)  P)j{T>at}  ~  (2iia)_1/2  e"a^yt  “ ^  (2t)_3/2 


•  /“  e^-(2/t)  )x  p  {  >x)dx/E  ,  U 

0  (2t)-Js  T0  (2t)"is  T0 


1_e(y(2t)"1/2  -y2/2) 


-1 


•  exp{(tat +1  H -at)  *  (y(2t)  3^2-y2/2)} 


as  a  -*•  «. 

The  probability  in  (76)  has  some  importance  in  statistics  in 

2 

that  it  is  the  Type  II  error  probability  for  a  "repeated  x  -test." 
The  approximation  given  above  was  obtained  earlier  by  Siegmund  [12] 
in  a  somewhat  different  form.  Verifying  that  the  two  forms  are 
equivalent  is  a  routine  exercise  in  the  use  of  Lemma  1. 

PROOF  OF  (88).  By  the  fundamental  identity  of  sequential  analysis, 

(U-(2/t)1/2)UT  +  T(t-1  -U2/2) 

(77)  P  {T  >  at)  -  /  e  dP  . 

y  {T>at}  (,2/ty 

-  /  exp{(u  -(2/t)1/2)(U_- (2aT)1/2)} 

(T>at)  T 

•  exp{T((l/t)-(y2/2))+(2aT)1/2(w-(2/t)1/2)}dP  . 


1 


Now  {T  >at)  -  {at  <T£at  4-a1^3}  U  {at+a1/,3<T}.  We  will  proceed  by 

evaluating  the  integral  on  the  event  {at  <  T  £at  +  a^3} ,  and  then 

1/3 

showing  that  the  integral  on  {at  +a  '  <  T}  is  of  smaller  order  of 

magnitude. 

1/3 

On  {at  < T£at +a  '  } , 

|(2aT)1/2  -  a(2t)1/2  -  (T  -  at) (2t)“1/2 |  <  C a"1/3 
for  some  constant  C  not  depending  on  a.  Thus 


1/2W„  l/2} 

exp{T((l/t)  -  (y2/2))  +(2aT)1/2(u  -  (2/t)1/2)} 


(78)  /  exp{(u-(2/t)1/^)(U_- (2aT)x/z)} 

{at<T<at-ta1/3}  T 


dP 


(2/t) 


£at+a1/3J  .  . 

I  f  exp{(p-{2/t)i/<J)(U  -(2aT)i/^)} 

n*«£at+l  J  {T”n) 

exp{(T-at)(y(2t)-1/2  -y2/2)} 

exp{-a[yt1/2  - /2]2/2}dP  ,  . 

(2/t)* 

1/3 

Next  we  deduce  from  Theorem  5  that  for  at  <  n  £  at  +  a  , 


The  relevant  nonlinear  process  In  this  problem  Is 

Z  -  U2/2n 
n  n 

-  (n/t)  +  (Un-n(2/t)1/2)(2/t)1/2 
+  (Un-n(2/t)1/2)2/2n 


with 

S  -  <2/t)1/2(U  -n(2t)"1/2) 
n  n 

C  -  (U  -n(2/t)1/2)2/2n  . 

n  n 

That  the  conditions  of  Theorem  5  are  satisfied  follows  from 
Proposition  2,  so 

(80)  P  ,  (T-n;  Z  -a<x) 

(2/ t)*  1 

~  (2va)"1/2  t"2(2t)"1/2/xP  ,{S  >y}dy/E  ,S 

0  {IftV  0  (2/t)*  T0 

-  (2Tra)-1/2  t~2(2t)_1/2  P  ,  {(2/t)1/2  U  > y ) 

0  <2t)“*  T0 

•  dy/E  ,  (2/t)1/2  U  . 

(2t)~^  0 

But 

ZT  -  a  -  U2/2T  -  a 

-  (UT-(2aT)1/2)(UT/2T  +  (a/2T)1/2)  ; 
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\d 


for  at  <  T  <  at  +  a1/3,  | (a/2T)1/2  -  (2t)-1/2  |  < (2a2/3  t2)-1,  and 

furthermore  for  any  6  >  0,  p  >  0,  P  .  { |u_/2T  -  (2t)-1^2 |  >  £}  - 

(2/t)*5  T 

o(a  P)  (by  any  one  of  a  host  of  large  deviation  theorems).  Therefore 
(79)  follows  from  (80) . 

Proposition  1  implies  that  the  family  of  random  variables 
0(UT  -(2aTa)1/2) 

*  a^2  e  a  1{T  *n  >at) 

0  a 

is  uniformly  integrable  with  respect  to  any  of  the  measures  P  , 

H  >  0.  Consequently,  we  may  sum  the  geometric  series  in  (78)  to 
obtain 

(81)  f  in  exp((y  -(2/t)1/2)(U_-(2aT)1/2)} 

(at<T<at+a1/3}  T 

exp(T((l/t)  -  (y2/2))  +(2aT)1/2(y-  (2/t)1/2)} 


note  that  for  n  >  at  +  a 


n((l/t)  -(y2/2))  +  (2an)^2(y  -(2/t)^2)  is  decreasing  in  n.  Thus 

/  <  exp{-(a  +  a1^3/t) [ pt 1 ^ 2  -  /2 ] 2/2 } 

(at+a1/J  <T) 

•E  .  exp{(y  -  (2/t)1/2)(U  -  (2aT)1/2)}  . 

(2/t)*5  T 

Proposition  1  guarantees  that  E  ,  exp((y  -  (2/t)^2)  (U  - (2aT)3^2) 

(2/t)h  T 

is  bounded  as  a  +“.  This  completes  the  proof  of  (76).  /// 

There  is  a  useful  generalization  of  Theorem  4  for  vector¬ 
valued  random  walks.  Let  be  i.i.d.  random  vectors  in  IR^ 

from  a  distribution  with  mean  vector  y  and  covariance  matrix  I,  and 
let  *  Y^  +  . . .  4-Y^.  Suppose  {£  }  Is  a  sequence  of  random  variables 
such  that  for  each  n,  is  independent  of  the  future 

°^n+l,^n+2’  * '  *  Deflne 

(82)  Z  -  aU(1)  +  Q  ,  a  >  0 

n  n  n 

T  »  T  -  min(n  >1  :  Z  >a) 
a  —  n 

(here  y^  denotes  the  i-th  coordinate  of  the  vector  y) . 

THEOREM  5.  Suppose  *  EY^^  >  0,  Y^^  has  a  (marginal)  non¬ 

lattice  distribution,  and  Y^  has  a  finite  absolute  fourth  moment.  If 
the  sequence  satisfies  assumptions  (A) -(D),  then 

(83)  P(Ta -n0(u,a);  ZT-a<x;  T~1/2(UT  -  T)  e  A) 

-  C(A,u)(y(1))3/2  01/2  a"1/2  /*  P(S  >  s}ds/ES 

T0  T0 

and 
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for  every  6  >  0) ;  consequently 


P(Ta=n0;  ZT-a<x;  T_1/2(Ut  -  T)  e  A} 


'  —1/? 

~  p^Ta=no;  zT~a<x;  n~  (Un  -n^cA) 

where  n^  =  £  ay  ^-a’^2^^]]]  as  before.  The  latter  probability  may 

be  evaluated  by  conditioning  on  3  and  proceeding  as  in  the  preced- 

ni 

ing  theorem,  with  one  change:  namely,  Lemma  4  must  be  altered  to 
allow  evaluation  of 


B+e 


nl  f(a>(y))p{z  edy;  n'1/2(U  -n.y)cA}  . 

-,a)(y)=A+a  nl  1  ni  1 

nl 

This  is  very  easily  accomplished  by  using  the  full  force  of  Stone's 
multidimensional  local  limit  theorem  (Theorem  1  of  [13]),  and  gives 
the  result 

(B+6  i 

i  1  f(o)(y))P{z  edy;  n1  (U  -n.p)  eA) 

4(y)-Ma  nl  1  nl  1 

nl 


C(A,u)(k/a)1/2(y(1)/a)1/2  j£A  f(co)da>  . 


The  rest  of  the  argument  is  the  same.  /// 

The  lattice  cases  are  not  nearly  so  pleasant.  Even  global 
limit  theorems  for  the  joint  distribution  of  T  and  ZT _ a  reflect  the 
dependence  of  the  random  walk  (S^)  and  the  perturbation  terms  £n 
(cf.  [9]);  local  theorems  will  reflect  it  even  more  clearly. 
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Let  be  i.i.d.  random  vectors  in  lRd  from  a  dis¬ 

tribution  with  mean  vector  y  and  covariance  matrix  and  let 
=  Y^  +  . . .  +  Y  .  Let  Q  :  1R^  -»■  K  be  a  quadratic  form,  i.e., 

(86)  Q(x)  =  Mx 

for  some  symmetric  matrix  M;  let  {£^1  be  a  sequence  of  random  vari¬ 
ables  satisfying  Assumptions  (A) -(D)  such  that  each  £n  is  independent 
of  the  future  a(Yn+^,...  ),  and  such  that  for  each  6>0 

(87)  P{|?J  >  €)  -  o(n“1/2)  ; 


and  let  {a^}  be  a  sequence  of  constants  satisfying 

max  la  -a  |  ->  0.  Define 

1  n  n+k' 


l<k<n 


(88)  Z  =  U<»  +  Q  (U  -  ny)n~1/2  +  E  +  a 

n  n  n  n  n 

T  =  T  =  min(n  > 1  :  Z  >  a) 
a  —  n 

2 

and  let  r  be  a  constant,  0  <  r  <  1.  Denote  by  0  the  variance  of 
y£X)  (thus  O2  =  $n). 

THEOREM  6.  Suppose  y^  =  EY^  >0,  Y^  has  an  arithmetic  distribu¬ 
tion  of  span  1  (i.e,  p{y^^  c  t  )  =  1),  and  Y^  has  a  finite  absolute 
fourth  moment.  Let  f  :  [0,“)  ■*  1R  be  a  bounded  continuous  function. 
Then  as  a  +  ®  through  r  +  2  , 


(89)  a1/2  Ef(ZT  -a)l(Ta=n0;  (UT  -  Tp)T  1/2  e  A) 


-  (p(1))3/2(2Tr)'d/2(det  $)  1/2(EU(1))_1 


{y:y(1)=ua;yeA}  M=0 


£  f(j+[(Q(y)+a  -  r)mod  1]) 


•  >  j  +1} 

T0 


-y  f  y/2  .  (2)  .  (d) 

•  e  3  T  1  dy  ...  dy  ->  0 


(90)  nQ  =  nQ(u,a)  =  a(p(1))_1  -  ua  1(ytl))3/2  +  o(a1/2) 


T.  =  min{n  >1  :  U(1)  >  0} 
U  —  n 


and  A  any  bounded  polyhedron  in  IR  .  If  instead  of  being  arithmetic 
is  supported  by  the  lattice  h  +  2  for  some  irrational  he  (0,1), 
then  as  a  through  r  +  2t, 


(91)  a 


1/2  Ef(ZT  -a)l(Ta-n0;  (UT  -  Ty)T_1/2  e  A> 
a 

-  („(1))3/2(2rt-d/2(d«  p^'WV1 

*■  n 


J  /  1% 

(y:yv'  '=ua;yeA} 


00 

£  f(j+[Q(y)+a  +  n~h-r]mod  1) 

J-0  n0  ° 

♦  p{uf1}  >  j  +  [Q(y)  +a  +nnh-r]mod  l) 
T0  “  n0  0 


.  e-y'rV/2  dy(2)  __  iyW  +  0  , 

The  relations  (89)  and  (91)  are  valid  uniformly  for  u  in  any  bounded 
subset  of  IR. 

The  proof  of  Theorem  6  will  be  omitted. 
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3 .  Remarks 


Professor  Siegmund  has  pointed  out  that  the  various  local 
theorems  derived  in  sections  1  and  2  may  be  used  to  obtain  large 
deviations  theorems  of  the  Bahadur-Ranga  Rao  type  (cf.  f 2 ] )  for 
stopped  sums,  provided  the  increments  have  finite  two-sided  Laplace 
transform.  For  example,  precise  asymptotic  expressions  for 

P(S  -t,(EX)>£t) 
a 

and 

P(S_  -T  (EX.)  >€T  }  , 

T  a  1  a 

a 


where 


T  =  min{n  :S  *X,  +  . . .  +X  >a} 
a  n  1  n 


and 

T  ■  min(n  :  S  >  /2a(c  +n)  } 
a  n 

are  available  for  IX^}  i.i.d.  ft(y,l),  exponential,  uniform  (0,1), 
etc.,  for  all  €  >  0.  The  derivations  are  so  simple  that  they  are 
left  for  the  amusement  of  the  reader. 

The  primary  impetus  for  this  work  was  a  desire  to  obtain 
asymptotic  approximations  for  the  Type  II  error  probabilities  of 
repeated  significance  tests  in  multiparameter  exponential  families. 
These  results  (which  use  Theorems  5  and  6)  will  appear  elsewhere. 
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